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ABSTRACT 

Using a general method for deriving identities for random vanaDies, i 
Und a numDer of new results involving characteristic fuxtions and 
genenaung ’unctions, "he method is simiply to promote a parame-er in 
an Integra; relation to the status of a random variable and then take 
expected values of both sides of the equation. Results include formulas 
‘■or calculating the characteristic functions for /x, i/x, v2 + Rt = 
■:’ ^ etc. If' tui'ms of integral transforms of the charactenstic 
functions fot x and i u), etc. Generaliza’ ions to higher dime’^sior-s oar 
be .Dtamed usir'C same method. E'pressions ’'or inverse.- iractiondi 
'^or e'"'*.:. Em;i\ ef'o jre also presefred, demors’r.aunn trp n-ieihoc 



As .s wei, known, it is sometimies easier to study a process using 
transforms of the relevant proPaPility distributions. Such transtorms 
'.nc ude- the characteiristic function, C(m). and the momirnt aeneratirc 
'unction, M(0), for general random variables, the probability aener.atmq 



"jnct.kon, C-iz.i, for integer valued random variables, ana the lablace 
of ‘he pnobability densry func/'on, ^(s). fo'" non-nega'. 've 



■ancorn 



They often allow one to 1 



simp 1 if u 



manipulations invoiving convolutions of probability distributions ar, sing 
fron'i consideration oi sures of raridorn variables and niorir ..on'ipii'ia'ud 



compound and branching processes, and 2) apply powerful methods from 
con-'Plex analysis and integral transform theory to tne solution of 
"Cerent lal-dif I erence equations which arise in the study of probability 
and stochast’c orocesses, and in the analysis of the analytic behavior of 
■hose solutions. The value of techniques for manipulating such 
f.r ansforms and of "methods for constructing new characteristic 
ojoctions out of given ones"’ ^s well ‘'■nown. In tact, the theory of 
p'^obability "depends to a large extent on the method of characteristic 
^jncMons"^. The methods presented here may further aid in the 
■nT.of-prptaT ion of complicated characteristic functions and facilitate the 
dertif ’cation o*' independent processes which contribute to the result 
see e.c reference [5]). ^part from their usefulness in probabilistic 
apphcat ons. our results also provide another means of generating new 
.ru.ogral ideruim-s from, old ones. 

ry omoftog a paramete-- an integral expression to the status of a 
rardcm variable i.r.v.; and then taKing expected values of both s'des of 
‘T'r uqujt'on, a number of interesting relations involving characteristic 
■'.net ions, generating functions, etc. are ^ound. In general, while there 
s no guarantee that the resulting integrals can be evaluated in closed 
•nrm for a particular distribution of interest, the expression may be 
oefpful in numerical work. An analogous technique for generating 
■u^ntimes nvoiving operators in Hubert space, matrices, etc. nas been 
.■.-hjliy employed physics (e.g. see the Appendix, below), in the 
cxobabititu context simda'' methods have long been used to so've 
pr.jp'ems by averaging conditional results over the conditioning variable. 
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A numDer of identities are presented in Sections 1! - V demonsfrat;ng 
e method of derivation. Some examples of calcula'iOns using tnese 
^entities are then carried ou' in Section VI. Finaliy. in Section V!1 we 
^omiment on ine generality of the method. 

11. Fie iQ. ions Ineol /'ing the Scuare ol k. V. s 

K Consider the weil-Knowr- int-rgrai t^.^pressinq the normal cat'cn cC a 
Normal cat a Saussian) distribution, m which x is an arbitrary constant, 

CX) 

f expf -(f ~ xi^/f2c^) ’ d'f = ' 

./fn-rr - 2 ] 

Change variables according to. c --> c/i2Z). l/(,2o^) iS. an 

<r <-• 

•w'L- t I , 



v'"''-'dTTS) 

Now p’'omote '■ f.o be a real random variable and take expected values 
not^' sides at the equation, assuming that tne irnplict interchange of 
'ntegrat'on is justiHed, ; e. 'hat | and E( I cor^"^’'Ute, 

CO 

/[ U(AnZ) ] fexp|-iCV( 4 ! 0 l C /0 dC = . ( 2 ) 

“OO 

I . No// T‘ijitiCMy C'!), i i ) by W!lh n ““^ 0 , 1 t, d ■ . to 

’ 'j c Jin, 



■? 

j 



GO 



\ \ ey.T)\-\C^/(^Z) * \ty ^i<y 1 = exp[ \15/^ ^ iSy" ] . 

Agair; consider x, y to be r.v.'s and lake expected values of both sides, 

oo 

i/[4Tr/(2fS) 1 |/exp{-i^2/(^^2^) -ie2/(48)l Cj< y(^.6) d(d6 (3) 
-00 

- C^a,j,2(2(,S) 

' A’9 now l&t 0 - We hdV9, 

oo 

I/Mitxi IJexpl-K!;^ ‘ e?)/(4»)| y((;.f) df.de (4) 

-OO 

- Cr2(?^) . 

■/V - h- = V- . 7(^15 >30 generalized further to 3 or more r.v. s 

^ an anaingous manner. 

^ ''"Ctipiy Eq. (Ij by exp( icfx) ana taie expected values to obtain the 
character'stic function for X- + x. 

00 

/[ i/(^Tt2f) 1 Jexp[-i^2/(42^)] + 2^) df; = . (5) 

- OO 

Adam, It IS clear that this may be generalized further. 
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l!i. identities for /x and l/x 

^ Consiae'" tne definite integral fe.g, reference [6] p. 3-4!), 

DO 

[ exp [ -a/c.2 1 d^ = /iTT/fgp)] Gxp[-2/(ab)] . (6) 

0 

lgI a b --> s"/'t to Obtain tne identity. 

CO 

f exp [ -x/r,^ i dC = /(tt; /s expi-s^x] . (7) 

0 

Now, proiTiOtG X to be a non-negative r.v. and average over x, to oDtai''' 
tne Laplace transform of tne pd»' of /x. 

00 

sZ/tt j exp 1 dC = SL . (8) 

0 

iternativeiy. a similar integral on p. 399 of reference [6] allows one to 
e.-press ^ /y(s) in terms of the characteristic function, . 

^ Tu obtain the Laplace transform of the pdf for fhe r.v '/x. i.e, 
iL- given , consider the integral'*^. 

X) 

_i exp[ -3^ ] Jo(b/0 do = ifa exp[ - b^V(9a;i 1. 

0 

Multiplu both Sides by a and change 'he parameters b 2v s. a 
the latte'" a non-negative r.v., to obtain. 
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CO 



; E! X Gxp[ -XC ] } Jo( 2/{sO ] rtc = E{ expf - s/x ] j. 

0 

;r te''ms of ihe Laplace transform, this is. 

00 

(-) / Jol 2/(sO I dt = i|/x(5)- (9) 

0 

i V. Identities for Non-Standard Moments and Averages 

Corsider the elernenlary integral, where x is just a parameter. 

OO 

; s''"'' ' GaP i -X s] Os = 

0 

NC/v promote x to Pe a non-necativG r,v., whose pcf falls off sufficiently 
■jp^Oiy as X --> -e.g. an Erlangfrc 1 ) j and take expected values wrt 

oo 

l/(n-l)! J s^"' 2,j^(s) ds = E{l/x^} (10a) 

0 

A.r:r,n x; --> ' X ^ Aj leads immed! 3 ‘^'y the 'dentity, 

' ! s'"''' expi-sA) ^,.(s) ds - E{l/(x-A)'^ 1 (lObj 

' A 

l]’ 

ide^'dnes for t^'ie Laplace transform could also be written in terms of 
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the moment generating function, when it exisis. Analogous results for 
trie moment generating function we^'e also derived in references f‘^], and 
[5! using methods similar to the ahove. '‘hose references also contain 
additional applications of this result. 

Consider, now. the integral. 

,V,i 

2 I exp [ -a t'^^] dt = /fTi/a) . ( i i ) 

0 

let a X. a non-negative r.v.. and take expected values. 

00 00 

2//jT j C^(it2) dt - 2//tt dt ^ E{l//x} (12) 

0 0 

Making the change of variable to u = t^' m Eg, (12) resuits n, 



1 /,/ TT f y 



i/2 -1 



l£,y(y j dy -• E { ' ! Jy ! 



■^his can be recognized as a fractional 'f'cegranon of orce'' i /2 of 
..apiace transform (or HGF). 5omie of t‘^e othe'' moments in tn^s section 
car, also be written as tract. onai integro-differentiations c; moment 
generat.r.g funct.ons or Laplace transforms. This fact, as well as other 
e:<tensions (anc related references) are discussed in references [7 - 9|. 
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Multiply Eq. (I 1) by a, let a — > x and average, to obtain, 

'X* 

2//n; I E{x expi-vt^]} dt = El/x), 

0 

or, svvitcbing to moment generating functions instead of Laplace 
transforms for this result (either could be used here), 

GO 

2//7t j at = E{/x}. (13) 

0 

■^his ca'"' be generalized to ODtam a formula for E( }. with m an 

'^-eger, n a straightforward manner. 

D, Consider Lipscnitz's integral”^ for the ordinary Bessel function of 
zeroth order, Jq. 



' e-,p[ -as ! jQ(bs) ds = l/v‘'(a" b^). 

j 

“'''omcte a --> x. a non-negative random variable and tafe expected 
a'ues 0 " both sides to obtain, 

00 

J Jo(bs) ds - E{ l//(x2 ^ b2) }. (M) 

0 

Successively differentiating this identity wrt the parameter b produces 
3 tarriiiy of similar identities. 



8 



E_ Consider one form of Bessel's integral for the n^*^ order oroinary 
Bessel function'*^, 

TT 

Jpjfx) = I/( 2 t() f exp[ -n I e *■ I x sin© ] d©, 

-TT 

let X be a r.v. and average over aii a. to obtain, 

7t 

E{ Jp,(x) } = i/(27t) I Gxpf -n i e 1 Cj^(sine) de. (15) 

-7T 

Clearly, this result can be genera'ized in many /vays, and is somewhat 
rerri!nisce'".t of the well-^ncwn "ormula. 

Ei • / = i/(2TT) ! nla^i C^(m) dco, 

v'/here Hlu..': is tne Fourier transform of H(x). The latter equation can, ir. 
f^e Spiro, of this paner, be simply derived by takinq expected vaiueS oi ^ 
T f^e rep’ esentat ion of H(x) as the Fourier Transform of HCto). 

. . Idprr fes for Probability Gene’^atiOQ ?^ijnct:ons 
^ Consider again the well-known integral used to define ttie gamma 
function, r.,n- i 

no 

e.<'o[ -s zi dz - ni / s'^'" ' . 

0 
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This time let n be a non-negalive integer valued random variable and 
ave’'age over n, 

00 

I G(z) expl -szl dz = E{ n! / * }. (16) 

0 

In pari.cuiar, when s = 1, this yields E{ n' ), when it exists, i.e. the 
i_ 3 piace transform of the probability generating function, evaluated at 
s = : IS lust Et ni } (cf. tne factorial moments E{n(n- 1 )---(n-kn )j = 

.d/'ClZ)'' Gtz) I 1 ). For non-integer r.v.'s we can obtain a corresponding 

expression for E{ Rx) ). 

R Consider the integral, 

-p 



N.jvv, let p oe a non-negative integer valued r.v. and averaae. 

1 

J G(z) dz ^ E{ l/(nO) }. (17) 

0 

wh'Ch also follows easily from the power series definition of G(zj and is 
jirectiy analogous to the usual result for E{n}. 



^ '.onsider the integral expressing the standard result for the even 
morrents of the Norma! distribution. 
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CO 



j expf -z^/(2a^) I gz = (2n - i)ii . 

/(2ttg2) 

where the double factorial symbol means, e.g , 5i> = 5-31. Again take 
averages over n on both sides of the equality, 

CO 

I G(z^) expf -z^/(2a^) I dz = E{ (2n - 1)!! ). (18) 

/(27ra2) 

and wnen o = i we have E{ (2n - l)ii }. 

Consider the two integrals, found on p. 56? of ''eference [61, 
tt/2 

: d9 - ^/2 fZrn - 1)'' / !2mVi 

c 

ar'd. 

r / 2 

j suaG [sirGe]”^' dO = (2m)'i / (2m ^ ' jn . 

0 

,.em, !''Q rr, be a r.v. and averaging over al’ values of m on each side oi 'he 
above equations, we obtain, 

ir/2 

2/7t J G( sin^G ) de = E{ (2m - 1 )!! / (2m)!! } . (19) 

0 



and. 



E{ (2m)!! / (2m ♦ 1)!! } . 



( 20 ) 



ix/2 

Jsine G( sin^e ) de - 
0 

"espGCtlV9lU. 

Vi. Some ADDiicalions of the identities 
^ .< .has a Normai distribution witn zero mean then 

" expl-C^cVz]. 

Putting this in Eg. (2) ana performing the integration, we have, 

CO 

C;, 2 ( 2 ) = /[ i/(4tt^) ] Jexp[-iC,2/(4?f) - C^o2/2 1 dC . 

-CO 



'^is ,5. indeed, recognized as the characteristic function for the X" 
jistr'bution with one degree of freedom. (Similarly, if x. y have 
'rCeDendpr.: normal distributions with the same value of the variance, 
'h.a^ r 2 = has a negative exponential distribution follows 

‘r viaiiy ’Pom Eg. (4). ) 

Now, let h.ive a Normal distribution with non-zero mean, p, then 

CPT) = exp{ i;iC - rJo^/2\. 

Subst'tutinq tnis in Eg. (2) and integrating, yields, 
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00 



c^ 2 (^) = /[ i/(47t25') 1 jexpi ipr - ;e2/(‘42<; - r^oV2 ] d2 . 

-00 

= l//(l - 2io2'p) exp{ ip2'p/(i - 2io^’'^) }, (22) 

A'hicri IS the characteristic function of an offset x' distriPut,on, 

^ LalcL'iate E(l//x } where x has an eAponentiai distribution witn 
parameter X. In this case the characteristic function of x is, 

Ly(c,j - X/(X “ I £) ). 

He'^ce. substituting this m Eg. (12) we have, 

CO 00 

2' /^ I Cy'it-) dt = 2/v n j X/(X " t-"i dt, 

0 c 

ana, ijsing a standard integral, we obtain, 

Efl/v^'^} - m/x. i 23 ; 

Thit IS easily verified to be correct by a airecf ca'cijlation. FI v I is 
also easily verified to be the result produced by Eg. (’5). 

^ Insert 'ne Laplace transform of the pdf for an exponential 
d istr iDut ion, X/tX s), into Eg. (Id;, obtaining, 

E'-. \ i ^ b^ 1 ) = I X/(X " s) Jp,(bs) ds 

0 
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il'J 



This integral is tabulated on p. 685 in reference (6i. resulting in, 

E( !//( ) ] = X Tl/2 [ Ho(bX) - No(bX) 1. (2^^) 

where Hq and Ng are Struve and Neumann functions, respectively, of 
.eercth order (Ng can be replaced with Yg, the Bessel function of the 
second Kind). For exanriple, taking b = and X = 1 ( HgC-l) = .1350 land 
Tgf^) = -.01 69*^ we find for the exponential distribution, 

E{ l//( x2 - p2 ) } = .2387 . 

which ;s easily confirmed by direct Gauss-Laguerre integration of fhe 
iefi-hjnd-side. 



D_ we now calculate the average of the order Bessel function when x 
has a N(0, o) distribution with the use of Eg. (15). After inserting the 
sharacterisiic ■unction for a normal distribution, using the trig identiiy 
sm-H ^ ■' ’ - cos26)/2, and again using Bessel's integral identity, this 
t-me for l./o. tq. (15) leads to, 

El ,p(x) ) = exp[ -o2/4 ) • ^25) 

•or n even, and zero when n is odd. This expression can be confirmed by 
t^vaiuat ng the expected value directly with the help of an integral 
tabulates on p. 710 of reference [6]. 

set G(z; be the generating function for a Poisson distribution, 

G(z^ = exp [ n (z - ’ ) 1. 
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Putting this in Eq. (16) and integrating yields. 



E{ ni / s*^^' } = l/(s - n ) ■ exp[ -n ]. (26) 

and. in particular, when s = 1, 

E{ n' i = 1 /( 1 - n ) • exp [ -n 1 . 

This IS easily verified to be correct, as well as the fact i.har for a 
Poisson distribution E{ n' } is only fimte for n < 1. 

L If we substitute the generating function for a Poisson r.v. into 
Eq.( 18) and perform the integration, we easily obtain (letting o = 1). 

L-' (2n - 1)11 } = 1//(1 - 2n ) • exp[ -n ]. .27 

Ciear'y, this is finite only for n <1/2. 

.Again using the generating function for a Poisson r.v.. Eq, (20) yie'ds, 
after using a trigonometric identity for sm^o and Bessel's integral 
representation for the Bessel function of zeroth order. 

£( (2iTi)ii / (2m * 1 )ii } - expi -n / 2 1 Jq(i n /2) 

- exp[ -n / 2 1 lo( n /2). ' 



where Ip is tne modified Bessel function of zeroth order. 
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^11. Conclusion 



SoTie 01 ' ifie foregoing integral loentmes involving characteristic 
functions and generating functions may De derived or verified using other 
methods. For examiple, 1 originally obtained Eg. (2) by expanding Cy 2 ('d) 

,n 3 "Ic^auri.n series, replacing the derivatives wrt 2 S by even order 
jer'vatives of C ...(0 wrt C. and re-summing the infinite series, foat 

"erivation, which relies on the existence of ail moments, is presented in 
■ne Appendix, Similarly, the expression for E{l/(n * i)) follows easily 
'>om integrating, term by term, the infinite series definition of 6 ( 2 ). In 
fact, expressions ♦'or fractional and/or inverse moments, including some 
'‘■'Ose dei'ived in Section IV. have been expressed elsewhere^'®’^ in a 
^nified manner ;n term,s of fractional integro-differentiations of the 
generalizing the usual formulas for moments and factorial 
moments. 

h^.-vvever. jOernate derivations are not readily identified for all of our 
•ntegfai ''eianons. The point is, that by presenting our unified treatment 
'containing as a proper subset some of the previously mentioned 
'O'rna'isms) It becomes straightforward to obtain new integral 
dent *.es for random variables by a judicious search of tables of 
:nt>rgra;s such as reference [ 6 ], As a final example, a somewhat 
gratuitous '‘esuit m obtained by consideration of integral no. 3 on p. 304 
in i'eferen<de 16], 



; exp I. -pt ) /[\ * exp(-qt) 1 dt = m/g cosec [pix/q], q > p > 0 , 

or q < p < 0 , 
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Let. q = I, p -> X. a r.v. in the interval [0, I] and average over x, 

00 

1/tT I hl^(-t) /[I + GXp(-t) ] dt = E{ COSGC [tt-x] }. (29) 

-CO 

It IS clGar that many other integral identities for random variables can 
be generated in the same manner. The only requirement is that the 
implicit interchange of orders of integration be justified. 
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APPENDIX 



In this appendix an alternate derivation of Eg. (2) is presented, patterned 
alter that in reference [3] in which it is applied to help in the 
interpretation of a complicated characteristic function and identify 
independent processes which combine to form the final process. The 
usual definition for the characteristic function yields, 

- E{ expOCx) } , and C\,. 2 (A) = E{ expfiAx^j }. (Ai i 

We solve the problem: given Cy . to tind C,y 2 . First, note t!~'at the even 
moments of x can be expressed alternatively as. 



[ l/i2(d/d02 T'C./.0\c,q 




}. 



or 



',A2j 



[ 1 / i (d/o2f ) C 





ne, the Ihs of these two expressions are equal, assuming the moments 
exist. 



.Ve can now write the ordinary McLaurin series for as, 

00 

= I [l/i (d/d'P') C.^2(t^')|2<'ro (A5,i 

m=0 

wnich car; oe rewritten using Eqs. (A2) as, 

= It -(d/af,)2 r C.^".)|,^ro (i2!r /ml . iA-!) 

m=Q 
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m 



Next, re-sum this power series in (d/dO" to obtain, 



Cy 2 (Zf) - exp { 


-i?^(d/dO^) C,,^(Ol^=o • ^^5) 


Now, note that. 





expl o-(d/d:';)^ } f(x) = iZ/CZmo^) ]' exp{ -(x - x')^/(2o2) r(x') dx'. 

which can be verified using the convolution theorem of Fourier 
transforms. This equation could also have been obtained directly from 



q. (i ) If we promote x to be the operator d/dx, instead of a r.v., and 



then post-multipiy by f(x). Making the change of variables x --> 
-2il', and setting c = 0 we recover Eq. (2). 
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